Image blur correction using a secondary camera

ABSTRACT

A device that employs a secondary camera for use in image blur correction. The device includes a first camera that acquires a digital image and a second camera that acquires a series of digital images that enable a determination of a motion of the device during acquisition of the digital image. The determined motion may be used to correct an image blur in the digital image acquired with the primary camera.

FIELD OF THE INVENTION

The invention relates generally to digital imaging and, moreparticularly, to image blur correction of digital images from a primarycamera using a secondary camera.

BACKGROUND OF THE INVENTION

A wide variety of devices include a camera for acquiring digital images.Examples of devices that may include a camera for acquiring digitalimages include handheld devices, e.g., cell phones, PDAs, and handheldcomputers, among others.

A digital image acquired by such a device may include image blur. Imageblur may be caused by movement of the device during digital imageacquisition.

A digital image that includes image blur caused by the movement of thedevice may be corrected by measuring the movement of the device and thenremoving the image blur from the digital image based on the measuredmovement. One technique for measuring the movement of a device tocorrect image blur may include equipping the device with anaccelerometer. An accelerometer, however, may increase the cost of thedevice and may undesirably increase the bulk of the device.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention is best understood from the following detailed descriptionwhen read in connection with the accompanying drawing. It is emphasizedthat, according to common practice, the various features of the drawingare not to scale. On the contrary, the dimensions of the variousfeatures are arbitrarily expanded or reduced for clarity. Moreover,common numerical references are used to represent likefeatures/elements. Included in the drawing are the following figures:

FIG. 1 is a block diagram illustrating a device in accordance with anembodiment of the invention;

FIG. 2A is a block diagram illustrating an image processor that performsimage blur correction in accordance with an embodiment of the invention;

FIG. 2B is a side view illustrating a device in accordance with anotherembodiment of the invention;

FIG. 3 is a diagram illustrating an example of image blur in a digitalimage;

FIG. 4 is a schematic diagram illustrating a dual-image device inaccordance with yet another embodiment of the invention; and

FIG. 5 is a flowchart illustrating a method of image blur correction inaccordance with yet another embodiment of the invention.

DETAILED DESCRIPTION

Blur correction may be used in many different application. Devices, suchas cameras, cell phones, PDAs, and handheld computers may encounterimage blur due to motion of the device during image capture (sampling).For example, a handheld device inadvertently may be moved by a user whenactivating a camera shutter control on the device. The inventors of thepresent invention have discovered that movement of the device may be dueto, for example, (i) depression of the control button for operating thecamera, (ii) movement of the camera shutter during operation; (iii)movement of the zoom and autofocus positions during operation of thecamera; and (iv) release of the control button. These movements generatenon-linear motion of the device, which may be estimated from frequencyresponse characteristics of the movement.

A secondary camera in such a handheld device may be used for image blurcorrection, and may be shared for other functions, such as video. Thus,the economic impact of an additional camera in a handheld device may beminimized. For example, the primary camera may provide higher resolutionimages, while the secondary camera provides lower resolution images athigher speeds.

FIG. 1 is a diagram illustrating a device in accordance with anembodiment of the invention. As shown, device 10 may include primarycamera 12 and secondary camera 14. Primary camera 12 may acquire digitalimage 20 and secondary camera 14 may acquire a series of digital images30. The digital images 30 from secondary camera 14 may enable adetermination of motion of device 10.

The primary camera 12 and secondary camera 14 may each include an arrayof light sensing elements. Each array of light sensing elements maysample incident light to provide (i.e., construct) one or more digitalimages. Primary camera 12 may be configured to acquire relatively highquality, e.g., high resolution, digital images relative to that ofsecondary camera 14. For example, the array of primary camera 12 mayhave 1 to 20 mega-pixels. In certain embodiments, primary camera 12 mayinclude a CMOS electronic rolling shutter (ERS) image sensor.

Although primary camera 12 is disclosed as including a CMOS sensor, itis contemplated that primary camera 12 may include any type of sensorelement which forms a digital image including a CCD image sensor.

Although the primary camera is shown as including an ERS image sensor,it is contemplated that primary camera 12 may include an image sensorwith an instantaneous shutter.

Primary camera 12 may sample incident light to form digital image 20.The sampling of the light may occur during a sample period T_(s).Digital image 20 may include an image blur that may be caused by amotion of device 10 during the sample period T_(s). The motion of device10 may cause image blur of differing degrees to different areas of thelight sensing elements (e.g., pixels, rows of pixels or columns ofpixels) in primary camera 12. This may be because, different rows of thearray of primary camera 12 sample light from a common source atdifferent subintervals of the sample period T_(s).

Secondary camera 14 using the array of light sensing elements, maysample light to form digital images 30. Secondary camera 14 may beconfigured to acquire images with a spatial resolution (i.e., pixels perimage) that is less than primary camera 12. In certain embodiments thespatial resolution of these images may be in the range of 20 by 20 to100 by 100 pixels. Other spatial resolutions are also possible.

Secondary camera 14 may sample the digital images 30 during sampleperiod T_(s). Secondary camera 14 may acquire the series of digitalimages 30 at a rate that is selected either by the user or setautomatically based on the sample period T_(s) of primary camera 12. Asthe rate which secondary camera 14 acquires the digital imagesincreases, the accuracy of the instantaneous motion (i.e., motionvectors) of device 10 may be improved. Secondary camera 14 may generatedigital images 30 at a rate sufficient for differences betweensuccessive digital images in the series of digital images 30 to enable adetermination of the motion of device 10. For example, if primary camera12 acquires 5 images per second and includes 1000 rows of pixels with arolling shutter of 5 rows, then secondary camera 14 may be set toacquire 1000 images per second to correct the image blur on a row-by rowbasis. As another examples, secondary camera 14 may acquire digitalimages 30 at a rate between 100 to 1000 images per second, althoughother rates are also possible.

It is contemplated that the rate of image acquisition of secondarycamera 14 may be sufficient to generate 2 to 1000 images during thesample period T_(s) of primary camera 12.

Images 20 and 30 may be stored in image processor 16 or in one or morememories (not shown).

In certain embodiments, device 10 may include image processor 16 fordetermining a set of motion vectors 44 in response to digital images 30.The motion vectors 44 may indicate the motion of device 10 during sampleperiod T_(s) (e.g., the acquisition period of digital image 20 byprimary camera 12).

Motion vectors 44 may be generated by image processor 16 at a relativelyfast rate (e.g., between 100 to 1000 motion vectors/second). Motionvectors 44 may be determined concurrently with sample period T_(s) orafter sample period T_(s). Respective motion vectors 44 or averagemotion vectors (the motion of device 10 averaged over respectiveperiods) may be based on the sample period for one row or multiply rows(i.e., subintervals of the sample period T). These motion vectors 44 maybe applied to adjust the signal level of the corresponding row or rowsof digital image 20 as they are affected by motion of device 10.

Motion vectors 44 derived from the series of digital images 30 may beused to perform blur correction to digital image 20 using known digitalimage processing techniques. A known processing technique for image blurcorrection is disclosed by S. Chitale et al. entitled “BlurIdentification and Correction for a Given Imaging System” published in1999 in Southeastcon '99 Proceedings IEEE, which is incorporated hereinby reference.

Alternatively, motion vectors 44 derived from digital images 30 may beused to counter motion of device 10 during sample period T_(s). Forexample, device 10 may include a mechanism for adjusting the physicalorientation of the imaging array of primary camera 12 to counter anyeffect of motion by device 10.

In various embodiments, primary camera 12 may generate a video image(e.g., a series of image frames). One skilled in the art understandsthat the motion vectors derived from digital images 30 using secondarycamera 14 may be used to perform blur correction or image stabilizationof video images generated by primary camera 12. The video blurcorrection or image stabilization may be performed using imageprocessing or using an opto-mechanical mechanism that compensates formotion of device 10.

Although the output signal of image processor 16 is shown as motionvectors 44, it is contemplated that other outputs may be included suchas image blur correction parameters 32, zoom positions and focuspositions. That is, image processor 16 may receive: (1) digital images30 from secondary camera 14; and (2) other image correction parameters,zoom positions, focus positions and/or the relative viewing orientationof the first and second cameras using detection unit 25. The imageprocessor 16 may then generate and output blur correction parametersbased on calculated motion vectors 44 and the received image correctionparameters.

FIG. 2A is a block diagram illustrating image processor 16 in accordancewith another embodiment of the invention. As shown, image processor 16performs image blur correction. The image processor 16 obtains (i) otherimage correction parameters, zoom positions, focus positions and therelative viewing orientation of primary and secondary cameras 12 and 14using detection unit 25; (ii) digital image 20 from primary camera 12(or a storage device; not shown); and (iii) the series of digital images30 from secondary camera 14 (or the storage device). In response tothese input signals, image processor 16 generates blur corrected image22. The blur corrected image 22 reduces image blur caused by motion ofdevice 10.

Image processor 16 includes motion vector generator 40 and image blurcorrector 42. Motion vector generator 40 generates motion vectors 44 inresponse to digital images 30. Image blur corrector 42 generates blurcorrected image 22 in response to motion vectors 44.

The device 10 may include mechanisms affecting the image blur of digitalimage 20. For example, primary camera 12 may include a zoom mechanismthat magnifies the image blur in digital image 20. Similarly, primarycamera 12 may include an auto-focus mechanism that affects the imageblur in digital image 20. The image processor 16 may capture and storepositions of the zoom mechanism and the auto-focus mechanism concurrentwith the sampling of digital images 30 for subsequent use in image blurcorrection.

The image processor 16 may also store timestamps. For example, imageprocessor 16 may capture and store timestamps corresponding to each ofthe digital images 30. Further, image processor 16 may capture and storeinformation regarding the position of the auto-focus mechanism, theposition of the zoom mechanism and/or the relative viewing orientationof secondary camera 14 to primary camera 12 immediately prior to thestart of sampling of a row of pixels of primary camera 12. Thetimestamps may be stored at the start of the sampling of each row andother timestamps may be stored which are related to the auto-focus andzoom mechanism positions and the relative viewing orientation of primaryand secondary cameras 12 and 14.

In certain embodiments image blur correction may be selectively disabledvia an external control signal to image processor 16. In theseembodiments, the user may select to read out image blur correctionparameters 32 either separately or together with digital image 20 toenable image blur correction external to device 10. The timestamps maybe used to externally correct digital image 20.

In certain embodiments, image processor 16 may generate a set of blurcorrection parameters 32 for digital image 20. The blur correctionparameters 32 may include the following.

-   -   (1) motion vectors in a first direction (the X direction) taken        at a predetermined rate;    -   (2) motion vectors in a second direction (the Y direction) taken        at the predetermined rate;    -   (3) rotation vectors taken at the predetermined rate;    -   (4) time stamp for each motion and rotation vector;    -   (5) zoom position of the primary camera, for example, taken        immediately prior to the start of sampling for predetermined        rows (e.g., each row) of the digital image from the primary        camera;    -   (6) auto-focus position of the primary camera, for example,        taken immediately prior to the start of sampling for        predetermined rows (e.g., each row) of the digital image of the        primary camera; and    -   (7) relative orientation of the secondary camera with respect to        the primary camera, for example, taken immediately prior to the        start of sampling for predetermined rows (e.g., each row) of the        digital image.

In certain embodiments, blur correction parameters 32 may also includean auto-focus and/or a zoom feature of secondary camera 14. The blurcorrection parameters may further include one or more of the following:

-   -   (i) zoom position of the secondary camera, for example, taken        immediately prior to the start of sampling for predetermined        rows (e.g., each row) of the digital image; and    -   (ii) auto-focus position of the secondary camera, for example,        taken immediately prior to the start of sampling for        predetermined rows (e.g., each row) of the digital image.

Although it is illustrated that the zoom positions and auto-focuspositions are acquired (taken) at the start of the sampling forpredetermined rows, it is contemplated that these positions may beacquired at the start of the sampling of a new frame of image data.Moreover, it is contemplated that the acquisition of the motion vectorsand other parameters may be at other times, such as during sampling ofcertain rows or after sampling of those rows. That is, these parametersmay be acquired anytime during the sampling of the rows, so long as theparameters have an associated timestamp or a defined timeframeassociated with each parameter.

The secondary camera 14 may have a fixed orientation with respect toprimary camera 12. One skilled in the art understands that the blurcorrection algorithm may include variables to account for the fixedorientation, or these variables may be hardwired into image processor16.

FIG. 2B is a schematic diagram illustrating a device 15 in accordancewith another embodiment of the invention. As shown in FIG. 2B, device 15includes primary camera 12 and secondary camera 14. The secondary camera14 may be movable with respect to primary camera 12. The device 15includes a sensor 45 (see FIG. 2A) to sense the relative position ofsecondary camera 14 with respect to primary camera 12. The sensor 45 maybe an optical sensor, a capacitive sensor or any other position-typesensor. For example, device 15 may be a flip-type cellular phone inwhich one of primary and secondary cameras 12, 14 may be disposed on aflip portion of the cellular phone and the other one of these cameras12, 14 may be disposed on the other portion of the cellular phone. Inthis configuration, the relative viewing orientation of the cameras isnot fixed. Sensor 45 may be located at hinge 48 of the flip phone suchthat the rotation of hinge 48 may be sensed. Alternately, one or moreswitches may be embedded in a hinged portion. These switches may beactuated by the rotation of the two arms of the phone. In thisconfiguration, actuation of one or more switches may be sufficient tosense the rotation of one camera with respect to the other camera.

In one embodiment, device 15 may support first and second relativeviewing orientations (for example, a first viewing orientation, when theflip phone is open and a second viewing orientation when it is closed)of primary and secondary cameras 12, 14. When the hinge positionindicates that device 15 is opened, an orientation switch may be one ofopen or short circuited. Moreover, when the hinge position indicatesthat device 15 is closed, an orientation switch may be the other one ofopen or short circuited.

In certain embodiments, sensor 45 may determine the viewing direction ofprimary camera 12 relative to that of secondary camera 14 (i.e., whetherthe viewing direction is the same or in a reversed viewing direction,e.g., 180° from the primary camera's direction). The relative viewingdirection of the primary and secondary cameras 12 and 14 may be based onan angle between their respective optical axes. The sensor 45 of device15 may detect the angle between the optical axes an provide the sensedangle to image processor 16.

Although a series of images 30 are illustrated for use in image blurcorrection, it is contemplated that two images from secondary camera 14may be used to correct image blur of digital image 20. If so, secondarycamera 14 may acquire digital images 30 at a lower rate, for example,between 10 to 100 frames per second.

Any number of different processes may be used to collect and store blurcorrection parameters 32. The blur correction parameters 32 may bestored in memory in device 10 and either read out with the image data orseparately read out from the image data. In certain embodiments, thestored blur correction parameters may be processed by image blurcorrector 42.

As examples, image processor 16 may: (i) embed blur correctionparameters 32 in digital image 20 using a predefined format; (ii) readout blur correction parameters 32 together with digital image 20 withoutembedding them into the image; or (iii) correct the blurred image basedon blur correction parameters 32 and read out blur corrected image 22.Other embodiments allow blur correction to be performed externally todevice 10 (e.g., digital image 20 with blur correction parameters 32 maybe transferred to a host computer for blur correction processing).

FIG. 3 is a diagram illustrating an example of image blur in a digitalimage. As shown, a digital image includes object 50. Motion of device 10during sample period T_(s) causes an image blur of object 50. Vector 60indicates the direction of motion of object 50 caused by movement ofdevice 10 during sample period T_(s). The time interval during whichobject 50 leaves its imprint (image blur) in the digital image refers toits sample period T_(s). Vector 60 may be derived from motion vectors44, the relative orientation of primary camera 12 to secondary camera 14and the other parameters provided by detection unit 25.

Blur correction may include subtracting the contribution of object 50from blurred areas of the digital image. A blur correction applied todigital image 20 may be based on an assumption that object 50 is fixedrelative to other objects in digital image 20 or that it moves in apredictable way with regard to the other objects (e.g., that themovement of object 50 corresponds to that of the other objects in thedigital image 20).

FIG. 4 is a block diagram illustrating a dual-image device in accordancewith yet another embodiment of the invention. As shown, device 100includes enclosure 110, lens 120, first imager 130, second imager 140,processor 150 and memory 160. The first imager 130 and second imager 140are provided on substrate 170, and each includes an array of imagingpixels (not shown). In certain embodiments, each of the imagers 130 and140 may be formed using CMOS (complementary metal-oxide semiconductor)type pixels. Other known fabrication techniques are also possible.

The first imager 130 may have a higher spatial resolution (i.e., numberof pixels) than second imager 140.

Lens 120 focuses light from a scene 180 in a field of view (FOV) onto animage plane at substrate 170. The first and second imagers 130 and 140are positioned to receive the focused light from lens 120. The firstimager 130 is configured to acquire an image during an integrationperiod T_(s). The image acquisition may be based on a rolling shuttertechnique or an instantaneous shutter technique.

A rolling shutter generally refers to a technique in which a few rows ofpixels (e.g., a portion of the image array) acquires the incoming lightat one time. The acquisition period (e.g., integration period) for aparticular row is offset such that acquisition of the image occurs insteps (in a rotational pattern). First imager 130 acquires a frame of animage by reading out the acquired row of pixels in the same rotationalpattern. For example, after the bottom row of first imager 130 startsits integration, the process rolls to the top row of first imager 130 tobegin acquisition of the next frame. Thus, acquisition and readout is acontinuous process.

An instantaneous shutter generally refers to a technique in which eachof the rows of pixels of the array acquires incoming light at one timeand readout occurs thereafter to generate the image of a frame.

In certain embodiments, second imager 140 may have a lower spatialresolution than first imager 130 and may use an instantaneous shuttertechnique to improve the estimation of motion vectors 44 of camera 100.

When device 100 moves during integration period Ts, the image acquiredby first imager 130 is image blurred. The extent of the image blurdepends on, for example, speed of the movement, acquisition time of theimage, and the zoom and focus position settings of camera 100.

Second imager 140 is configured to acquire a series of images duringintegration period T_(s) of first imager 130. The processor 150 maycompare (correlate) common features in the images from second imager 140to calculate the motion vectors 44 of device 100.

It is contemplated that the motion vectors may be calculated for eachconsecutive pair of images in the series or the motion may be averagedover a series of images. Each motion vector may be timestampped with atime corresponding to when the motion is detected.

Because first and second imagers 130 and 140 are located together indevice 100, they experience the same motion vectors such that the imagesfrom first imager 130 may be corrected based on the motion vectorscalculated using second imager 140.

In certain embodiments, device 100 may use a red eye reduction orpreprocessing image technique. In these embodiments, it is contemplatedthat image capture by second imager 140 may begin based on a triggeringmechanism for the red eye reduction or the preprocessing imagetechnique.

The calculation of motion vectors 44 of device 10 is based on: (i) anobject in the field of view being stationary; or (ii) the object movingconsistently (e.g., at an average velocity). It is contemplated that themotion vectors of first and second imagers 130 and 140 may be correlatedfrom a portion of scene 180 within the field of view of second imager140. For example, certain stationary features of the image may beselected, such as a building, a tree or a boulder to calculate themotion vectors.

In certain embodiments, image processor 16 may calculate additionalmotion vectors of further objects from digital images 30 to determine anaverage velocity of the object and further objects. The image blurcorrection of digital image 20 may be based on the calculated motionvectors and the determined average velocity of the object and furtherobjects. That is, the motion vectors of device 100 may be based on theaverage velocity of the objects in the field of view.

In various embodiments, second imager 140 may generate images at afaster rate than first imager 130. That is, second imager 140 may have agreater temporal resolution. Moreover, second imager 140 may have alower spatial resolution (i.e., less pixels per image).

Processor 150 may be configured to generate motion vectors for device100 by calculating location differences based on stationary featurescommon to the series of images from second imager 140. Based on thelocation differences, processor 150 may calculate the motion vectorsindicative of motion in the x-axis and/or y-axis directions during theintegration (capture interval) of first imager 130.

In certain embodiments, the calculated x and y motion vectors includefirst x and first y axis motion vectors with subsequent motion vectorsdifferentially calculated (i.e., based on a difference between theprevious and next motion vectors in the x and y directions). Suchdifferential motion vectors allow for reduced memory storage capacitywhen the motion vectors are substantially constant. In otherembodiments, the x and y motion vectors may be generated as calculatedresultant vectors during each predetermined period (e.g., the period tocapture an image by second imager 140 during the interval between eachpair of consecutive images).

By positioning first imager 130 and second imager 140 on a commonsubstrate 170, lens 120 may be shared to reduce the cost of the systemover other configurations in which the first and second imagers do notshare such a lens.

FIG. 5 is a flowchart illustrating a method 500 in accordance with yetanother embodiment of the invention. In step 510, first device 12acquires digital image 20. At step 520, second device 14 acquires aseries of digital images 30 during sample period T_(s) of first device12.

At step 530, motion vector generator 40 of image processor 16 receivesdigital images 30 to determine motion vectors 44 to be applied todigital image 20.

At step 540, detection unit 25 detects sensed parameters. The sensedparameters may include, for example, (1) the zoom position of firstdevice 12 and/or the second device 14; (ii) the focus position of thesedevices; and/or (iii) relative viewing orientation of these devices.

At step 550, image processor 16 calculates image blur correctionparameters 32 from the determined motion vectors 44 and sensedparameters.

At optional step 560, image processor 16 may store in memory (its memoryor another memory): (i) motion vectors 44 and sensed parameters or (2)calculated blur correction parameters 32, for example, to be read out toexternally blur correct digital image 20.

At step 570, image processor 16 or another external device may correctimage blur of the image from first device 12 based on blur correctionparameters 32.

Although the invention is described in terms of a device having aprimary and a secondary camera on a substrate, it is contemplated thatportions of the device may be implemented on multiple substrates or insoftware on microprocessors, ASICs or general purpose computers (notshown). In various embodiments, one or more of the functions may beimplemented in software that controls a general purpose computer. Thissoftware may be embodied in a tangible computer readable carrier, forexample, a physical computer readable medium (i.e., a magnetic disk, anoptical disk or a memory-card) or an audio frequency, radio-frequency,or optical carrier.

Although the invention is illustrated and described herein withreference to specific embodiments, the invention is not intended to belimited to the details shown. Rather, various modifications may be madein the details within the scope and range of equivalents of the claimsand without departing from the invention.

1. A device, comprising: a first camera using a rolling shutter foracquiring a first image having a plurality of rows of pixels; a secondcamera for acquiring a set of digital images of an object at a higherimage acquisition rate than an image acquisition rate of the firstcamera such that the higher image acquisition rate is sufficient tocalculate a motion vector of the object for individual blur correctionof each row of pixels of the first image; and a processor forsequentially calculating each motion vector of the object based on theset of images of the object from the second camera, wherein: theprocessor provides the individual blur correction for a respective rowof pixels of the first image based on one of the sequentially calculatedmotion vectors corresponding in time to a time of capture of the firstimage by the respective row of pixels.
 2. The device of claim 1, whereinthe object is stationary and image blur is caused by movement of thefirst camera.
 3. The device of claim 1, wherein the processor calculatesmotion vectors of further objects from the set of digital images todetermine an average velocity of the object and further objects andprovides the individual blur corrections of the first image based on thedetermined average velocity of the object and further objects.
 4. Thedevice of claim 1, further comprising a sensor for detecting anorientation angle between the first and second cameras, wherein: thefirst and second cameras have different viewing orientations, and theprocessor provides the individual blur corrections of the first imagebased on the calculated motion vectors and the detected orientationangle.
 5. The device of claim 1, wherein the processor calculates themotion vectors for the individual blur corrections of the first digitalimage at times during image acquisition of the first image.
 6. Thedevice of claim 5, wherein each of the sequentially calculated motionvectors has a timestamp associated therewith such that the individualblur corrections or a respective one or ones of rows of pixels in thefirst camera is based on the respective motion vectors occurring at atime of image capture of the respective one or ones of the rows ofpixels.
 7. The device of claim 1, further comprising: a detection unitto detect at least one of: (i) an auto focus position of the firstcamera; or (ii) a zoom position of the first camera, wherein the imageprocessor calculates the blur correction parameters based on the atleast one detected zoom or auto-focus position of the first camera. 8.The device of claim 1, wherein the higher image acquisition rate of thesecond camera is in the range of about 2 to 1000 times faster than theimage acquisition rate of the first camera.
 9. The device of claim 1,wherein the processor derives blur correction parameters based thesequentially calculated motion vectors and at least one of: (i) a zoomposition of the first camera; (ii) an auto-focus position of the firstcamera or (iii) a relative viewing orientation of the second camera withrespect to the first camera.
 10. The device of claim 9, wherein therelative viewing orientation of the second camera with respect to thefirst camera is a predetermined orientation.
 11. The device of claim 9,further comprising: an orientation switch configured to sense one of:(1) when the second camera is in a first relative position with respectto the first camera or (2) when the second camera is in a secondrelative position with respect to the first camera, wherein theprocessor provides the individual blur corrections based on the sensedrelative position.
 12. The device of claim 1, wherein the processorembeds the individual blur corrections of the first image in the firstimage.
 13. The device of claim 1, wherein the first image and theindividual blur corrections of the first image are readout together. 14.The device of claim 1, further comprising: a memory, wherein theprocessor corrects the first image based on the individual blurcorrections and the memory stores and reads out a blur corrected firstimage.
 15. The device of claim 1, wherein the first camera includes afirst imager and the second camera includes a second imager such thatthe first and second imagers are deposed on a common substrate and sharea common lens.
 16. The device of claim 15, wherein the processor and thefirst and second imagers are formed on the common substrate.
 17. Amethod of correcting image blur using first and second imaging devices,the first and second imaging devices having different viewingorientations, comprising the steps of: acquiring, by the first imagingdevice, a first image having a plurality of rows of pixels using arolling shutter; acquiring a set of digital images of an object usingthe second imaging device; setting an image acquisition rate of thesecond camera at a higher image acquisition rate than an imageacquisition rate of the first camera such that the higher imageacquisition rate is sufficient to calculate a motion vector of theobject for individual blur correction of each row of pixels of the firstimage; sequentially calculating each motion vector of the object basedon the set of images of the object from the second camera; and derivingan individual blur correction for each respective row of pixels of thefirst image based on a respective one of the sequentially calculatedmotion vectors corresponding in time to a time of capture of the firstimage by the respective row of pixels.
 18. The method of claim 17,further comprising the step of: calculating motion vectors of furtherobjects from the set of digital images; determining an average velocityof the object and further objects; and deriving the individual blurcorrection of the first image based on the determined average velocityof the object and further objects.
 19. The method of claim 17, furthercomprising the steps of: detecting an orientation angle between thefirst and second cameras; and deriving the individual blur correctionsof the first image based on the sequentially calculated motion vectorsand the detected orientation angle.
 20. The method of claim 17, wherein:the step of sequentially calculating the motion vectors of the objectincludes the steps of: comparing pairs of the respective images of theacquired set of digital images; calculating the motion vectors of thesecond imaging device based on the comparison of the pairs of therespective images; and the step of deriving the individual blurcorrections of the first image includes translating the sequentiallycalculated motion vectors of the second imaging device to blurcorrection parameters in accordance the orientation angle detectedduring the acquisition of the pairs of the respective images.
 21. Themethod of claim 20, wherein: the step of sequentially calculating themotion vectors includes timestamping each of the motion vectors with anassociated timestamp; and the step of deriving the individual blurcorrections of the first image includes matching one of the sequentiallycalculated motion vectors to one row of pixels of the first image basedon the associated timestamp corresponding to the time when the firstimage is captured for the one row of pixels of the first image;adjusting an intensity of the respective row of pixels of the firstimage in accordance with the translated blur correction parametersderived from the sequentially calculated motion vectors of the secondimaging device.
 22. The method of claim 17, further comprising the stepof: storing the sequentially calculated motion vectors and thecorresponding detected orientation angle for respective pairs of the setof digital images of the second imaging device.
 23. A physical computerreadable medium to store program code for execution on a computer toimplement the method according to claim
 17. 24. An apparatus forcorrecting an image blur of a first digital image of a first imager,comprising: a second imager in a predetermined orientation with respectto the first imager for acquiring a plurality of further digital imageswhile the first imager samples the first digital image; and an imageprocessor for receiving (i) the first digital image having the imageblur and (ii) the plurality of further digital images from the secondimager, for determining blur correction parameters based on a motion ofthe first imager using the acquired plurality of further digital imagesfrom the second imager and for applying the blur correction parametersto the first digital image having the image blur to reduce orsubstantially eliminate the image blur from the first digital image,wherein: the first imager uses a rolling shutter; the first digitalimage has a plurality of rows of pixels; the second imager has a higherimage acquisition rate than an image acquisition rate of the firstimager such that the higher image acquisition rate is sufficient todetermine individual blur corrections of each row of pixels of the firstimage; and the image processor determines the individual blurcorrections for each respective row of pixels of the first digital imagebased on calculated motion vectors corresponding in time to a time ofcapture of the first image by the respective row of pixels.